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Abstract 

Introduction: Urinary tract infection (UTI) is one of the most common types of infection. Currently, diagnosis is primarily based on microbiologic 
culture, which is time- and labor-consuming. The aim of this study was to assess the diagnostic accuracy of urinalysis results from UriSed (77 Electro- 
nica, Budapest, Hungary), an automated microscopic image-based sediment analyzer, in predicting positive urine cultures. 

Materials and methods: We examined a total of 384 urine specimens from hospitalized patients and outpatients attending our hospital on the 
same day for urinalysis, dipstick tests and semi-guantitative urine culture. The urinalysis results were compared with those of conventional semi- 
guantitative urine culture. 

Results: Of 384 urinary specimens, 68 were positive for bacteriuria by culture, and were thus considered true positives. Comparison of these results 
with those obtained from the UriSed analyzer indicated that the analyzer had a specificity of 91.1%, a sensitivity of 47.0%, a positive predictive value 
(PPV) of 53.3% (95% confidence interval (CI) = 40.8-65.3), and a negative predictive value (NPV) of 88.8% (95% CI = 85.0-91.8%). The accuracy was 
83.3% when the urine leukocyte parameter was used, 76.8% when bacteriuria analysis of urinary sediment was used, and 85.1% when the bacte- 
riuria and leukocyturia parameters were combined. The presence of nitrite was the best indicator of culture positivity (99.3% specificity) but had a 
negative likelihood ratio of 0.7, indicating that it was not a reliable clinical test. 

Conclusions: Although the specificity of the UriSed analyzer was within acceptable limits, the sensitivity value was low. Thus, UriSed urinalysis re- 
sults do not accurately predict the outcome of culture. 
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Introduction 

Urinary tract infection (UTI) is one of the most 
common types of infection. It is typically diag- 
nosed on the basis of symptoms, signs and urinal- 
ysis, and early diagnosis and treatment are very 
important (1). Semi-quantitative culture of a urine 
specimen is the gold standard for UTI diagnosis 
and the only method that can provide detailed in- 
formation on urinary bacterial infection (2). How- 
ever, urine culture is costly, the analysis takes at 
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least 24 hours, and up to 60-80% of the results are 
negative (3). Therefore, faster screening methods 
that could cull some of the culture-negative urine 
samples are needed to improve the efficiency of 
urine sample handling. 

Urinalyses with a manual dipstick or microscopic 
urine sediment analysis are valued as quick and in- 
expensive screening methods (2). These tests are 
often used in conjunction with or in place of a 
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urine culture for diagnosing a UTI. However, the 
techniques are labor-intensive and time-consum- 
ing, and they can suffer from considerable interob- 
server variability (4). Recently, automated instru- 
ments capable of examining urine for cells and 
particles have been introduced for the analysis of 
unspun urine. Some use a video camera and im- 
age-based analysis to capture and sort particles 
based on their dimensions (5), while others use the 
principles of flow cytometry (6). Several studies 
have shown that flow cytometry and image analysis 
can be used to detect bacteria in the urine (3,5-9). 

The UriSed automated urine microscopic analyzer 
(77 Electronica, Budapest, Hungary) is a new system 
that microscopically analyzes samples using image 
processing software and a Digital Imaging Cell Iden- 
tification system (10) connected to a LabUMat auto- 
mated urine chemistry analyzer (77 Electronica, Bu- 
dapest, Hungary). Although several studies have 
evaluated the diagnostic accuracy of various ana- 
lyzers in predicting urine culture positivity, there are 
insufficient and conflicting data on the ability of the 
UriSed analyzer to distinguish urine samples with 
and without significant bacteriuria (11,12). 

Here, we assessed the diagnostic accuracy of the 
UriSed analyzer for predicting positive urine cul- 
tures in a routine hospital laboratory setting. 

Materials and methods 

Study design and subjects 

For this study of diagnostic accuracy, we enrolled a 
total of 402 unselected consecutive patients who 
attended the Sevket Yilmaz Research and Educa- 
tion Hospital on the same day with suspected UTI 
in January of 2009. The decision to obtain both uri- 
nalysis and a urine culture were made by the eval- 
uating physicians as a part of their routine practice. 
No attempt was made to change current physician 
practice. 

Specimens from all age groups and both genders 
were included. Urine samples were sent to the lab- 
oratory from different departments, including the 
Departments of Medicine, Surgery, Gynecology 
and Pediatrics, and the Intensive Care Unit (ICU). 
History of UTI and clinical findings were recorded. 
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In most cases, patients were asked to wipe their 
external genitalia with wet tissues before urinat- 
ing, and to collect urine samples during spontane- 
ous urination (clean catch midstream). Specimens 
from the ICU patients were collected after new in- 
sertion of an indwelling Foley catheter under asep- 
tic conditions. The urine samples were collected in 
disposable, sterile, neutral containers with screw 
lids (FiratMed; Istanbul, Turkey) and were proc- 
essed within 2 h of collection. 

First-morning urine samples of sufficient volume 
(> 10 mL) were accepted. Urinalysis was performed 
by a trained technician in the biochemistry labora- 
tory. Urine culture was performed in a microbiol- 
ogy laboratory, and bacterial concentrations were 
determined by a single microbiologist. 

Eighteen patients (17 female, 1 male) who were 
hospitalized and had been prescribed antimicrobi- 
als whose activity spectra included all microorgan- 
isms isolated from the index urine culture were ex- 
cluded from the study. Data from the remaining 
384 patients were evaluated. 

Semi-quantitative urine culture 

A calibrated 0.001 mL bacteriologic loop was used 
to inoculate urine onto 5% (v/v) Columbia blood 
agar and Eosin Methylene Blue (EMB) agar plates 
(Biomerieux, Marcy I'Etoile, France) within 30 min 
of collection. Inoculated plates were incubated 
aerobically at 37 °C for 18 to 24 h (13). 

Bacterial concentrations were expressed as the 
numbers of colony forming units (CFU) per millilit- 
er. A sample was considered culture-positive if it 
contained a pure culture of > 10 5 CFU/mL in 
asymptomatic cases. Under symptomatic condi- 
tions (dysuria, urgency, urinary frequency, flank 
pain, loin-to-groin pain, suprapubic pain, and/or 
urinary retention), > 10 4 CFU/mL was viewed as 
significant (14). Identification of pathogenic micro- 
organisms was performed using the Vitek 1 auto- 
mated system (Biomerieux, Marcy I'Etoile, France) 
according to the manufacturer's instructions. 

Urinalysis by the UriSed Automated System 

The UriSed Automated Urinalysis System performs 
automated urine microscopy followed by auto- 
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mated urine chemistry analysis, using a LabUMat 
(77 Electronica, Budapest, Hungary). The device 
centrifuges the urine sample at 2000 rpm for 10 s, 
collects the particles from the bottom of the basin, 
and microscopically examines the samples under 
15 fields at 400 x magnification. The UriSed ma- 
chine takes photographs through a built-in micro- 
scope at several stages of processing, and evalu- 
ates the data via image processing software that is 
able to detect and further classify particular urine 
particles (15). Test strip urinalysis (LabStrip U11 Plus; 
Analyticon Biotechnologies AG, Lichtenfels, Ger- 
many) is carried out prior to image analysis via the 
LabUMat. In the present study, urinary leukocyte 
esterase (LE) and nitrite tests were also assessed. 

Before analysis of specimens, two urine samples 
were analyzed for quality-control purposes (Quant- 
scopics; Quantimetrix, California, CA). Between- 
run quality control was assured by analyzing the 
results from QC1 and QC2. Within-run precision 
was determined by analyzing specimens spiked 
with various concentrations of erythrocytes, leu- 
kocytes and epithelial cells, with 12-20 replicates 
(usually 15) performed for each sample. The preci- 
sion of each measurement method was assessed 
by analyzing the coefficients of variation (CVs), 
which were calculated as percentages. 

The present study was approved by the Bursa Re- 
gional Ethics Committee, and all participants or 
their parents (in the case of children) or next-of-kin 
gave written informed consent. All procedures 
were performed in accordance with the Second 
Declaration of Helsinki. 

Statistical analysis 

Statistical analyses were carried out using SPSS 
13.0 for Windows (SPSS Inc., Chicago, IL, USA), with 
culture results taken as the gold standard. For 
analysis, samples were divided into two groups: 
culture negative and culture positive. The diagnos- 
tic accuracy of WBC and bacterial counts for UTI 
was measured by the area under the curve (AUC) 
for the receiver operating characteristic (ROC), and 
the confidence interval (CI) was calculated (16). 

Using the positive culture as the gold standard, 
sensitivity (SE) (true positive [TP] / [TP + false nega- 
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tive {FN}]), specificity (SP) (true negative [TN] / [TN 
+ false positive {FP}]), positive and negative predic- 
tive values (PPV, NPV), accuracy (TN + TP) / (TN + 
TP + FN + FP), positive likelihood ratio (LR+): [SE / 
(1 -SP)] and negative likelihood ratio (LR-): [(1-SE) / 
SP] were calculated (16). The Youden index [calcu- 
lated as the maximum (SE + SP - 1) value] was used 
to estimate the best cut off points for discriminat- 
ing samples in the positive and negative groups. 

Results 

Specimens were obtained from 262 females (68%; 
mean age, 48 years; age range, 2 to 91 years) and 
122 males (32%; mean age, 52 years; age range, 2 
to 83 years). The majority of samples (73%) were 
from outpatients. 

Urine samples were evaluated by semi-quantita- 
tive urine culture, and 68 (18%) of the specimens 
yielded positive cultures. The microorganisms iso- 
lated from these cultures are listed in Table 1. 
Among the isolated bacteria, Escherichia coli was 
the most common. 

A sample was designated 'positive' if the particle 
count for bacteria exceeded 44 cell/ul and the leu- 
kocyte count exceeded 14 cell/ul. These cut off val- 
ues were established using the Youden index 
method (1 6), and were consistent with those found 
in a previous study (3). 

ROC curve analyses showed that the discriminato- 
ry power for leukocytes (AUC = 0.819; 95% CI, 
0.767-0.870) was greater than that for bacteria 
(0.626; 95% CI, 0.549-0.703). 



Table 1. Microorganisms isolated from 68 positive urine cul- 
tures. 



Microorganism(s) 


No. 


Escherichia coli 


49 


Klebsiella pneumoniae 


10 


Pseudomonas aeruginosa 


3 


Enterobacter aerogenes 


2 


Staphylococcus aureus 


2 


Morganella morganii 


1 


Proteus mirabilis 


1 
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Parameters of diagnostic accuracy are summarized 
in Table 2. 

Using the bacteria count alone (> 44 cell/ul) for de- 
termining significant bacteriuria, we obtained a 
sensitivity of 55.8% (95% CI, 43.8-67.7 %), a specifi- 
city of 81.3% (95% CI, 76.4-85.0 %), a PPV of 39.1% 
(95% CI, 30.0-49.1 %), and an NPV of 89.5% (95% CI, 
85.4-92.5 %). The specificity of 81.3% reflects that 
30 of the culture-negative patients had findings for 
bacteria above the cut off value for urinalysis (16). 

Using the leukocyte count (> 14 cell/ul), we ob- 
tained a specificity of 91.1% (i.e., it correctly identi- 
fied 91.1% of those who did not have a positive 
culture finding). The PPV and NPV were 53.3% (95% 
CI, 40.8-65.3 %) and 88.8% (95% CI, 85.0-91.8 %), 
respectively, indicating that use of the leukocytu- 
ria parameter alone to detect culture positivity 
would result in a large number of false positives 
and some false-negatives. 



Nitrite positivity was found to be the most accu- 
rate (85.6%) test for detecting culture positivity. It 
also showed acceptable specificity and positive 
and negative predictive values. Nitrite positivity 
yielded the highest LR+ ratio, which is the best in- 
dicator for ruling-in diagnosis (16). 

The LR-s were found to be generally inadequate 
for all of the studied measurements (for all param- 
eters, > 0.3) (16). 

Discussion 

The present study found that 82% of urine cultures 
were negative, which is comparable to previous 
reports by other authors (3,11,12), and studies 
showing that the percentage of culture-negative 
samples is ~ 65 to 80% (6-9,17). The nitrite and LE 
analyses were found to have very high specificity 
but low sensitivities, which agrees with previous 



Table 2. Sensitivity, specificity, positive and negative predictive values, likelihood ratios and accuracy for prediction of urinary tract 
infection from urinalysis. 



Parameter 


SE (%) 


SP 

(%) 


PPV 

(%) 


NPV 

(%) 


LR+ 


LR- 


Accuracy 

(%) 


N0 2 


22.0 


99.3 


88.2 


85.5 


34.8 


0.7 


85.6 


(13.2-34.0) 


(97.4-99.8) 


(65.6-96.7) 


(81.5-88.7) 


(8.1-148.8) 


(0.6-0.8) 


(81.7-89.0) 


LE 


33.8 


93.6 


53.4 


86.8 


5.3 


0.7 


83.0 


(23.0-46) 


(90.2-95.9) 


(38.9-67.4) 


(82.7-89.9) 


(3.1-9.1) 


(0.5-0.8) 


(78.9-86.6) 


Leukocytes 1 


47.0 
(34.9-59) 


91.1 

(87.3-93.9) 


53.3 
(40.8-65.3) 


88.8 
(85.0-91.8) 


5.3 
(3.4-8.1) 


0.5 
(0.4-0.7) 


83.3 
(79.1-86.9) 


Bacteria 2 


55.8 


81.3 


39.1 


89.5 


2.9 


0.5 


76.8 


(43.3-67.7) 


(76.4-85.3) 


(30.0-49.1) 


(85.4-92.5) 


(2.1-4.0) 


(0.4-0.7) 


(72.2-80.9) 


Bacteria 2 


35.2 


95.8 


64.8 


87.3 


8.5 


0.6 


85.1 


and leukocytes 1 


(24.3-47.9) 


(92.8-97.6) 


(48.7-78.1) 


(83.4-90.4) 


(4.6-15.9) 


(0.5-0.8) 


(81.0-88.5) 


Bacteria 2 and LE 


36.76 


95.8 


65.7 


87.5 


8.9 


0.6 


85.4 


(25.6-49.3) 


(92.8-97.6) 


(49.8-78.7) 


(83.6-90.6) 


(4.8-16.5) 


(0.5-0.7) 


(81.3-88.8) 


Bacteria 2 or LE 


73.5 


78.4 


42.3 


93.2 


3.4 


0.3 


77.6 


(61.2-83.1) 


(73.3-82.8) 


(33.8-51.3) 


(89.5-95.6) 


(2.6-4.4) 


(0.2-0.5) 


(72.9-81.6) 


Leukocytes, 1 


19.1 


98.1 


68.4 


84.9 


10.0 


0.8 


84.1 


bacteria 2 and LE 


(10.9-30.8) 


(95.7-99.2) 


(46.0-84.6) 


(80.8-88.2) 


(3.9-25.5) 


(0.7-0.9) 


(79.9-87.0) 


Bacteria 2 and LE or N0 2 


33.3 


97.1 


70.9 


87.5 


11.7 


0.6 


86.1 


(22.5-46.1) 


(94.5-98.8) 


(53.4-83.9) 


(83.6-90.5) 


(5.6-24.4) 


(0.5-0.8) 


(81.9-89.2) 



Numbers in parentheses are 95% Confidence Intervals calculated with binominal expansion. 
1 Cut off value for leukocytes > 14/ul. 
2 Cut off value for bacteria > 44/ul. 

LE - leukocyte esterase; N0 2 - nitrite; SE - sensitivity; SP - specificity; NPV - negative predictive value; PPV - positive predictive value; 
LR+ - positive likelihood ratio; LR- - negative likelihood ratio. 



Biochemia Medica 2013;23(2):2 7 7 -7 



http://dx.doi.org/10. 7 1 61 3/BM.201 3.025 



Huysal K. et a). 



Diagnostic accuracy of urine microscopic analyzer 



reports (11,18,19). Nitrite alone had a relatively high 
positive likelihood ratio (34.8), and thus might be 
useful for ruling in disease. However, it had a rela- 
tively poor negative likelihood ratio (0.7), suggest- 
ing that it may not be useful for ruling out disease 
(16). It should be noted that bacteria such as Sta- 
phylococcus saprophytics, enterococci, and Aci- 
netobacter species do not reduce nitrate to nitrite, 
and may therefore yield false-negative results (2). 
Another limitation is that the test requires a speci- 
men of the first urine produced in the morning, as 
bacteria require 4 h to convert nitrate to nitrite at 
reliably detectable levels (2). 

Consistent with other reports (11,18,19), LE alone 
appears to be a relatively poor test both for ruling 
in (pooled LR+ = 5.3) and ruling out disease 
(pooled LR- = 0.5). The false-positive and false- 
negative results that were observed for the LE val- 
ues may reflect leukocytes, eosinophils, and Tri- 
chomonas spp. passing from vaginal fluid to the 
urine, as well as urine nitrites, hypotonic and alka- 
line urine, abnormal urine pH, and high bilirubin, 
protein, and hemoglobin values (11). 

The value of microscopic examination of urine in 
screening for UTI is still controversial. The detec- 
tion of urine culture positivity using spot bacteriu- 
ria has shown sensitivities of 52-98% (8,11,12,17,18), 
but it is difficult to directly compare these results 
because the reported sensitivities and specificities 
depend on the definitions used for gold standard 
positive and negative urines, which can vary 
among laboratories. For example, some authors 
consider a urine sample positive if it contains more 
than 10 4 CFU/mL (11,12), while others consider > 
10 3 CFU/mL to reflect positivity (20). 

Various reports have indicated that the most ac- 
ceptable bacteriuria data are obtained using flow- 
cytometric systems (5-8,20). Differences in the re- 
sults obtained from various analyzers might be at- 
tributable to different patient populations, differ- 
ent definitions of significant bacteriuria, variable 
features of urine (i.e., cellular debris may some- 
times be misclassified as bacteria), different cut off 
values, and the fact that the instruments use dif- 
ferent methods to detect bacteria. When evaluat- 
ing bacteriuria results, users must also remember 



that culture detects only live bacteria, whereas the 
analytic systems are incapable of differentiating 
live bacteria from dead, or pathogenic versus non- 
pathogenic bacteria. 

For the UriSed analyzer bacteriuria data to be use- 
ful in culling negative urine samples, it should 
show a high sensitivity and a high negative predic- 
tive value (16). In the present study, however, the 
bacteriuria data obtained from the UriSed urina- 
lyzer showed low sensitivity (55.8%) and a low NPV. 
The specificity of the UriSed bacteriuria parameter 
was acceptable, but the PPV (39.1%) was low. The 
problem with NPV and PPV is that they are de- 
pendent on the prevalence of disease in the popu- 
lation (16); if the prevalence decreases, the PPV will 
decrease and the NPV will increase. Overall, how- 
ever, the relatively large number of false negatives 
and low sensitivity are not acceptable, since a false 
negative urine test will prohibit the urine from be- 
ing cultured. 

The presence of leukocytes in urine reflects an in- 
flammatory response in the urinary tract. On ROC 
analyses performed for clinical evaluations, higher 
AUC values were obtained from leukocyte counts 
versus bacteriuria data, indicating that the discrim- 
inatory power of leukocyturia was greater than 
that of bacteriuria. However, the use of the leuko- 
cyturia parameter alone to detect culture positivi- 
ty would result in a large number of false positives 
and some false negatives. When evaluating false- 
positive results in female patients without infec- 
tion, researchers should consider other important 
conditions, such as leucorrhea, fever, pregnancy, 
and administration of certain drugs (18,22,23). The 
presence of few or no leukocytes in urine is con- 
sistent with the absence of an inflammatory re- 
sponse in colonized (rather than infected) individ- 
uals. In addition, false-negative WBC counts might 
be obtained in patients with cell lysis. 

We compared several combinations of parameters 
to determine if they could predict positive urine 
cultures, potentially allowing us to safely and rap- 
idly cull negative samples. In various prior studies, 
the combination of bacteria, leukocytes, nitrite, 
and leukocyte esterase measures yielded a high 
specificity and high PPV, but the false-negative 
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rate was also high (11,17,24). Thus, the issues of 
high NPV and low sensitivity must be considered 
when these four parameters are used together. 

Kellogg and co-workers (25) suggested that a 
screening test for early detection of urine-culture- 
positive patients must have a 95% sensitivity and a 
95% NPV. A useful laboratory test should have a 
sum of sensitivity and specificity > 1 70% (26). Thus, 
a laboratory test with 95% sensitivity and 95% spe- 
cificity (sum = 190) should be considered an excel- 
lent test (26). In our present study, no parameter or 
combination thereof met these criteria. 

Comparison of the data we obtained from the 
UriSed urinalysis system with previous reports 
showed that the specificity values were similar, but 
our sensitivity was very low. It is difficult to com- 
pare sensitivities, as the cut off values for bacteriu- 
ria and leukocyturia vary widely among studies 



(3,7-9,11,12,15,17-21,23). Instead of using the values 
suggested by the operator's manual, further stud- 
ies should be undertaken to determine acceptable 
figures for these parameters. Such an evaluation 
should be conducted prior to autoanalyzer instal- 
lation. 

Our study has some limitations. First, although the 
outpatients were asked to provide early morning 
urine samples, this was not verified. Furthermore, 
the number of enrolled patients was relatively 
small for the determination of a > 90 agreement 
rate. 

In conclusion, we found that the use of the UriSed 
analyzer and urine strips, whether used separately 
or in combination, did not accurately predict the 
outcome of urine cultures. 
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